HP-PDNo. 200312020 

1 SYSTEM AND METHOD FOR PRIORITIZING CONTACTS 
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19 BACKGROUND OF THE INVENTION 

20 1. Field of the Invention 

21 The present invention relates generally to systems and methods for call handling, and 

22 more particularly to for prioritizing contacts. 

23 2. Discussion of Background Art 

24 Automated call handling systems, such as Interactive Voice Response (TVR) systems, 

25 using Automatic Speech Recognition (ASR) and Text-to-speech (TTS) software are 

26 increasingly important tools for providing information and services to contacts in a more cost 
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1 efficient manner. IVR systems are typically hosted by call centers that enable contacts to 

2 interact with corporate databases and services over a telephone using a combination of voice 

3 utterances and telephone button presses. IVR systems are particularly cost effective when a 

4 large number of contacts require data or services that are very similar in nature, such as 

5 banking account checking, ticket reservations, etc., and thus can be handled in an automated 

6 manner often providing a substantial cost savings due to a need for fewer human operators. 

7 Many call centers enable contacts to leave a message so that an agent, operator or 

8 customer representative can get back to the contact after analyzing the message and finding 

9 the most suitable solution. These messages are first placed in a queue so that when a next 

10 operator becomes available, the operator can select a message to respond to. 

11 The criterion for selecting which message should be responded to first is important for 

12 the call center. Some commonly used criteria include: First In - First Out (FIFO) whereby 

13 contacts are responded to in the order the call center received their message; geographically 

14 influenced selection, which takes into consideration the caller's time zone and operators 

15 available in that time zone; permitting the contact to self prioritize their message based on 

16 some predefined criteria, such as loss of life, mission critical, major business problem, minor 

17 business problem, non critical issue; permitting the operator to select which message to 

18 answer next after listening to many if not most of the messages in the queue; and so on. 

19 Each of the above techniques, however, often yields less than optimal selection 

20 results. For instance, blind selection techniques like first-in-first-out (FIFO) typically leave 

21 some important calls and contacts on-hold for a long time while other less critical calls are 

22 responded to first; contact-driven techniques (i.e. self prioritization) often results in a 

23 misleading message priority determination since many contacts tend to think that their 

24 problem is the most urgent; and operator selection techniques tend to be inefficient and time 

25 consuming. 
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1 In response to the concerns discussed above, what is needed is a system and method 

2 for prioritizing messages that overcomes the problems of the prior art. 
3 
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1 SUMMARY OF THE INVENTION 

2 The present invention is a system and method for prioritizing. The method of the 

3 present invention includes: receiving a set of requests from a set of contacts to be connected 

4 to a recipient; generating a first priority level score for each request based on an acoustical 

5 analysis of a contact speech signal within the request; generating a second priority level score 

6 for each request based on a keyword analysis of the request; combining the priority level 

7 scores for each request into a combined priority level score; prioritizing the requests within 

8 the set of requests based on their respective combined priority level scores; and routing to the 

9 recipient that request, from the set of requests, having a highest combined priority level score. 

10 The system of the present invention includes all means and mediums for implementing the 

11 method. 

12 These and other aspects of the invention will be recognized by those skilled in the art 

13 upon review of the detailed description, drawings, and claims set forth below. 
14 
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1 BRIEF DESCRIPTION OF THE DRAWINGS 

2 Figure 1 is a dataflow diagram of one embodiment of a system for prioritizing 

3 contacts; 

4 } Figure 2 is a flowchart of one embodiment of a root method for prioritizing contacts; 

5 and 

6 Figures 3 A, B, and C are a flowchart of one expanded embodiment of the root method 

7 for prioritizing contacts. 
8 
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1 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

2 The present invention presents a system and method that prioritizes messages and on- 

3 hold contacts waiting for a response from a recipient. Messages are prioritized using a 

4 plurality of classifiers both at an acoustic level and a textual and attributive level. Use of 

5 multiple classifiers helps improve the system's prioritization accuracy and ensure that 

6 important calls are handled first. Such increased prioritization accuracy should also help 

7 improve customer satisfaction and a call center's business operations. 

8 In a preferred embodiment discussed below, the recipient is an operator at a call 

9 center. However, those skilled in the art will recognize that the prioritization system and 

10 method discuss is equally applicable toward any prioritization space, including prioritizing 

11 messages within a person's e-mail in-box, prioritizing bills to be paid, and so on. 

12 Messages can be prioritized in any number of ways depending upon how the present 

13 invention is applied. For example, messages can be prioritized by their urgency, importance, 

14 business relevance, latency, origin, classification, content, emotional content, contact 

15 assigned priority, and so on. The messages themselves can be transmitted by any medium 

16 such as telephone, cell phone, fax, and e-mail. 

17 Some examples of how contacts and messages can be prioritized include: giving a 

18 higher priority to messages from angry or frustrated contacts; giving a lower priority to 

19 messages from calm contacts; giving higher priority to contact who are on-hold and muttering 

20 to themselves; giving higher priority to angry or sad emotions in a customer care context; and 

21 giving higher priority to panic emotions in an emergency-91 1 applications. 

22 Call center statistics with respect to any particular prioritization approach can be kept 

23 an analyzed to help fine tune how contacts and messages are prioritized so as to ensure 

24 overall call center performance. 
25 
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1 Figure 1 is a dataflow diagram of one embodiment of a system 100 for prioritizing 

2 contacts. The call handling system 104 of the present invention preferably provides some 

3 type of voice interactive information management service to a set of contacts. Anticipated 

4 information services include those associated with customer response centers, enterprise help 

5 desks, business generation and marketing functions, competitive intelligence methods, as well 

6 as many others. Contacts may be customers, employees, or any party in need of the call 

7 handling system's services. Also while the discussion below is sometimes discussed with 

8 respect to only one contact, the invention's functionality is intended to extend to a set of 

9 contacts. 

10 To begin, the call handling system 104 receives a request from a contact to be 

11 connected to an operator 106. Note, while the present invention is discussed with respect to 

12 human operators at a call center, the invention is applicable as well to any system or method 

13 that must prioritize a series of tasks, messages, etc. for later execution by either a person or a 

14 machine, such as a computer. If the operator is available, a contact manager 108 connects the 

15 contact 102 to the operator 106. The contact's 102 "request" is herein defined to be either in 

16 the form of a message left by a contact or in the form of a contact waiting on-hold for a next 

17 available operator. 

18 If the operator is not available, the contact manager 108 connects the contact 102 to an 

19 Interactive Voice Response (IVR) module 110. The IVR module 110 provides an automated 

20 interface between the contact's 102 speech signals, received over a voice channel, and the 

21 system's 104 overall functionality. To support such an interface with the contact 102, the 

22 IVR module 1 10 may include a Text-To-Speech (TTS) translator, Natural Language 

23 Processing (NLP ) algorithms, Automated Speech Recognition (ASR), and various other 

24 dialog interpretation (e.g. a Voice-XML interpreter) tools. 

25 The IVR module 1 10 records and stores a first message from the contact 102 in a 

26 message mailbox 112. The IVR module associates a priority level attribute with the contact 

7 



HP-PDNo. 200312020 

1 102 and the first message. The priority level attribute is used to order contacts placed in an 

2 on-hold queue 1 16 and messages left by contacts in the message mailbox 112. The priority 

3 level attribute is preferably assigned a confidence score that is continuous in nature, and 

4 ranges from p=0.0 to p=1.0, where p=0.0 indicates a lowest possible priority level, and p=1.0 

5 indicating a highest possible priority level. As is discussed below, the operator 106 is 

6 expected to respond first to higher priority contacts in the on-hold queue 116 and higher 

7 priority messages in the message mailbox 112. 

8 Next, the IVR module 110 asks the contact 102 to select and assign a priority level, to 

9 the first message, from a list of priority levels. In one embodiment, the priority levels, and 

10 their associated confidence scores, could be: emergency priority (p=1.0), high priority 

11 (p=0.8), medium priority (p=0.5), and low priority (p=0.2). The priority levels can also be 

12 dynamically adjusted using various learning algorithms such as those discussed below. Those 

13 skilled in the art will recognize that other priority levels and associated confidence scores 

14 could also be used. 

15 The IVR module associates a second set of attributes with the first message. These 

16 attributes preferably include the contact's 102 phone number and calling location, a contact 

17 ID, a time and date, and so on. The priority level attribute and the second set of attributes are 

18 stored in a message attributes database 1 14. 

19 If the contact 102 has requested to be put "on-hold", the IVR module 1 10 routes the 

20 contact 102 to the on-hold queue 116. While on-hold, the contact 102 can be streamed music, 

21 advertisements, and the like. The IVR module 110 collects and stores a second message from 

22 the contact 102 in the message mailbox 1 12. 

23 Note that the first message from the contact 102 is one in which the contact 102 

24 explicitly requests a service or information from the call handling system 104 and is most 

25 useful in providing substantive information to the operator 106. The second message from 

26 the contact 102, however, continually records the contact's 102 utterances while the contact 
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1 102 is on-hold, and is most useful in providing information on the contact's 102 emotional 

2 state while on-hold (e.g. the contact's 102 "mutterings"). The second message in some cases 

3 may also provide additional substantive information with respect to the contact's 102 original 

4 reason for contacting the call handling system 104. 

5 In the discussion that follows, all of the information from the contact 102, such as the 

6 first message, the second message, and the attributes, are used to help generate a combined 

7 confidence score for the priority level attribute. Contacts and messages having higher 

8 combined confidence scores are preferably presented to and responded to by the operator 106 

9 before those having lower combined confidence scores. Except for the priority level 

10 confidence scores assigned directly by the contact 102, the system 104 preferably calculates 

11 confidence scores for the priority level attribute using one or more well known techniques, 

12 such as those employing Neural Networks, Support Vector Machines, K-NNs, Gaussian 

13 Mixture Models (GMMS), decision trees, and other classifiers. 
14 

15 Acoustic Classifier 

16 Next, an acoustic classifier 118 accesses the first and second messages stored in the 

17 message mailbox 112. The acoustic classifier 118 generates a set of emotional confidence 

18 scores for the first and second messages with respect to a set of predefined emotions base on 

19 acoustic features found within the messages. The predefined emotions preferably include: 

20 sadness, boredom, happiness, hot anger, cold anger, frustration, panic and calmness. The 

21 feature set used by the acoustic classifier 1 18 to generate these emotional confidence scores 

22 may include: pitch contour statistics, contour statistics of the first derivative of the pitch, 

23 energy contour statistics, contour statistics of the first derivative of the energy, and audible 

24 and inaudible duration features. A confusion matrix also is used to help assign the emotional 

25 confidence scores. 
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1 Next, the acoustic classifier 118 sets a priority level confidence score for the priority 

2 level attribute to a predetermined value based on a predetermined set of the emotional 

3 confidence scores. For instance, a highly emotional contact 102 may be associated with a 

4 higher priority than a relatively calm contact 102. The acoustic classifier 118 stores the 

5 confidence score for the priority level attribute in the message attributes database 1 14. 
6 

7 Keyword Classifier 

8 The automated speech recognition (ASR) engine within the IVR module 1 10 converts 

9 the first and second messages stored in the message mailbox 112 into a textual file. A 

10 keyword classifier 120 searches the textual file for a predetermined set of keywords or key 

11 phrases. Some of the predetermined keywords include: "urgently", "as soon as possible", 

12 immediately", "ok", "wait till later", "fine", and "no problem" are identified within the 

13 textual file. The set of keywords and key phrases are preferably prepared off-line and 

14 expanded using natural language processing techniques (e.g. hyponym expansion using 

15 WordNet). The keywords are stored in a database or a look-up table. The set of keywords 

16 can also be readily adjusted to search for keywords and phrases in many other languages. 

17 The keyword classifier 120 sets a priority level confidence score for the priority level 

18 attribute to a predetermined value base on whether the message includes a predefined set and 

19 number of the keywords and key phrases. For example, if the messages include the keyword 

20 "urgently" or its synonyms at least five times, then the priority level confidence score is 

21 preferably set to a high priority level such as p=0.7. Whereas, if the messages include the 

22 keyword "no problem" or its synonyms several times, then the priority level confidence score 

23 is preferably set to a low priority level such as p=0. 1. 

24 However, since multiple conflicting assignments are possible (e.g. what if the user 

25 says "it's not urgent?") various HMMs, Bayesian, and conditional probabilities which 

26 consider each of the words in the contact's 102 sentence are used as well. For instance, a 
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1 summed priority level based on all the keywords found, their context and their relative 

2 priorities can be used. 

3 The keyword classifier 120 stores the confidence score in the message attributes 

4 database 114. 
5 

6 Business Relevance Classifier 

7 A business relevance classifier 122 searches the textual file, introduced above, for a 

8 predetermined set of business relevance keywords related to a predefined set of business 

9 relevance categories 124. Depending upon an application of the present invention, these 

10 business relevance categories 124 may include: name or division of the company from which 

11 the contact 102 is calling; who the contact 102 is at the company (e.g. president, manager, 

12 etc.); volume of business done with the contact 102; contacts calling about a unique problem 

13 (e.g. a recall); whether the contact has a service contract; historical data associated with the 

14 contact 102, such as the contact's 102 prior reasons for contacting the system 104, and so on. 

15 Those skilled in the art will know of many other business relevance categories. 

16 The business relevance classifier 122 sets a priority level confidence score for the 

17 priority level attribute to a predetermined value based on whether the message includes a 

18 predefined set and number of the business relevance keywords. The business relevance 

19 keywords are stored in a database or a look-up table. For example, if the messages include 

20 the business relevance keyword "president", then the priority level confidence score is 

21 preferably set to a high priority level such as p=0.8. Whereas, if the messages include the 

22 keyword "Company Q" and the system 104 has records indicating that a very low volume of 

23 business is done with "Company Q", then the priority level confidence score is preferably set 

24 to a low priority level such as p=0.1. 
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1 Since multiple conflicting assignments are possible (e.g. what if the user says "it's not 

2 urgent?") various HMMs, Bayesian, and conditional probabilities which look at all of the 

3 words in the contact's 102 sentence are used as well. 

4 The business relevance classifier 122 stores the confidence score for the priority level 

5 attribute in the message attributes database 114. 
6 

7 Contact-Assigned Priority Classifier 

8 A contact-assigned priority level classifier 126 identifies the priority level assigned to 

9 the first message by the contact 102. As mentioned above, the priority levels preferably 

10 include: emergency priority, high priority, medium priority, and low priority. 

11 The contact-assigned priority level classifier 126 sets a contact-assigned priority level 

12 confidence score equal to one of a set of predetermined priority level confidence scores, 

13 depending upon the priority level assigned by the contact 102. For example, if the contact- 

14 assigned priority level is "high priority" then the contact- assigned priority level classifier 126 

15 sets the contact-assigned priority level confidence score to p= 0.8. Similarly, if the contact- 

16 assigned priority level is "low priority" then the contact-assigned priority level classifier 126 

17 sets the contact-assigned priority level confidence score to p= 0.2. 

18 Next, the priority level classifier 126 stores the confidence score for the priority level 

19 attribute in the message attributes database 1 14. 
20 

21 Other Classifiers 

22 Those skilled in the art will recognize that other priority level classification modules 

23 may also be used to generate a priority level attribute confidence score for a contact or 

24 message. 
25 
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1 Data Combiner 

2 A data combiner 128 retrieves each of the confidence scores stored in the message 

3 attributes database 1 14 by the various classifiers 118, 120, 122, and 126 for the priority level 

4 attribute. The combiner 128 dynamically assigns a weight to each of the confidence scores 

5 depending upon the classifier from which the confidence score was received. The weighting 

6 is dynamic since the weights are constantly revised using ground truth data from the ongoing 

7 activities of the call handling system 104 and how well each of the classifiers predicted 

8 message and contact priority levels. 

9 For example, while the contact assigned priority level gives the contact 102 an 

10 opportunity to honestly assign the priority level based on the contact's 102 perception of the 

11 contact's 102 own prioritization need, the combiner 128 preferably does not over weight the 

12 contact assigned priority level, because some contacts might improperly assign a higher 

13 priority level than appropriate in order to move their call or message up in either the on-hold 

14 queue 1 16 or the message mailbox 1 12. The weight assigned to the contact assigned priority 

15 level score is also preferably influenced by: the contact's 102 reputation for accurately 

16 assessing the priority level; whether the contact 102 has already spent a predetermined 

17 amount of time in dialog with the IVR module 110; and the business relevance categories 124 

18 discussed above. 

19 The data combiner 128 calculates a combined confidence score for the priority level 

20 attribute based on all the confidence scores received from the various classifiers. The 

21 combined confidence score can be calculated in several different ways depending upon how 

22 statistically independent the different classifiers 118, 120, 122, and 126 are. 

23 One calculation method uses an equal- weighted product combination. The equal 

24 weighted method equally weights and multiplies together the confidence score from each of 

25 the classifiers 118, 120, 122, and 126 to yield the combined confidence score. 
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Another calculation method is the weighted linear summation, according to the 
following formula: 

N 

S = X r P ■ w here N is a total number of classifiers, r is a weight assigned to 
classifier j, and Pj is a confidence score generated by Classifier j) 



A third calculation method is the weighted exponential, according to the following 



formula: 



s=Y\pj 



i (where N is a total number of classifiers, r is a weight assigned to 



classifier j, and Pj is a confidence score generated by Classifier j) 

A third calculation method uses a neural net, such as Multiple Layer Perception 
(MLP) network, with {p 1 ,/? 2 ,...,p iV } as the input. 

The combiner 128 stores the combined confidence score for the priority level attribute 
in the message attributes database 114. 

The following table presents one example of how confidence scores from the different 
classifiers 118, 120, 122, and 126 can be weighted and combined to generate a single 
combined confidence score for the priority level attribute. In this example, the keyword 
classifier 120 and contact-assigned priority classifier 126 have been weighted half as much as 
the acoustic classifier 118 and the business relevance classifier 122. 
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2 More sophisticated confidence score combination techniques can be used as well. For 

3 instance, the call handling system 104 could use historical data from the various classifiers to 

4 train a statistical classifier (for example, a neural network, SVM, linear regression, etc.), that 

5 would then be used to prioritize the contacts and messages based on runtime scores. 

6 Also, since some of the classifiers 118, 120, 122, and 126 may be computationally complex, 

7 such as the keyword classifier's 120 and business relevance classifier's 122 use of Automatic 

8 Speech Recognition, the present invention's efficiency is preferably increased by use of a 

9 hierarchical classifier strategy. One embodiment of such a hierarchical strategy includes: 
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1 generating and combining priority level scores only until the combined priority level score 

2 exceeds a current highest combined priority level score for all of the other requests. Another 

3 embodiment of such a hierarchical strategy includes: identifying computational resources 

4 required to calculate each of the priority level scores; generating priority level scores for a 

5 new request hierarchically beginning with a priority level score requiring a least amount of 

6 computational resources; and stopping generation of the priority level scores once the 

7 combined priority level score for a new request exceeds a current highest combined priority 

8 level score. 

9 For example, if the combined confidence scores from the acoustic classifier 118 and 

10 the contact-assigned priority classifier 126 already exceed all other combined confidence 

11 scores, then that contact or contact's message can be immediately placed first in either the on- 

12 hold queue 1 16 or message mailbox 112 obviating a need to engage the computationally 

13 costly keyword classifier 120 and business relevance classifier 122. 
14 

15 Sorting and Retrieving from the Message Mailbox and On-Hold Queue 

16 The contact manager 108 sorts the messages in the message mailbox 112 and the 

17 contacts in the on-hold queue 116 based on their respective combined confidence scores 

18 stored in the message attributes database 1 14. Preferably, contact having a highest combined 

19 confidence score is first in the on-hold queue 116, and the message having a highest 

20 combined confidence score is first in the message mailbox 112. 

21 Since the system 104 preferably operates in real-time, every time a new message is 

22 stored in the message mailbox 1 12, or a new contact is placed in the on-hold queue 1 16, the 

23 system 1(34 generates a new combined confidence score and the contact manager 108 resorts 

24 the messages in the message mailbox 1 12 and the contacts in the on-hold queue 116. 

25 Next, the operator 106 requests a next message in the message mailbox 1 12 or 

26 connection to a next contact on-hold in the on-hold queue 1 16. The contact manager 108 

16 
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1 sends the highest priority message in the message mailbox 1 12 to the operator 106, or 

2 connects the operator 106 to the highest priority contact in the on-hold queue 1 16. 

3 

4 Figure 2 is a flowchart of one embodiment of a root method 200 for prioritizing 

5 contacts. In step 202 a set of requests is received from a set of contacts to be connected to an 

6 operator. In step 204, a first priority level score is generated for the requests based on an 

7 acoustical analysis of a contact speech signal within the request. In step 206, a second 

8 priority level score is generated for the request based on a keyword analysis of the request. In 

9 step 208, the priority level scores are combined into a combined priority level score. In step 

10 210, the request within the set of requests is prioritized based on the combined priority level 

11 score. In step 212, a request, from the set of requests, having a highest combined priority 

12 level score is routed to the operator. The root method 200 is discussed in further detail with 

13 respect to Figures 3 A, B, and C. 
14 

15 Figures 3 A, B, and C are a flowchart of one expanded embodiment 300 of the root 

16 method for prioritizing contacts. To begin, in step 302, the call handling system 104 receives 

17 a request from a contact to be connected to an operator 106. In step 304, if the operator is 

18 available, a contact manager 108 connects the contact 102 to the operator 106. In step 306, if 

19 the operator is not available, the contact manager 108 connects the contact 102 to an 

20 Interactive Voice Response (IVR) module 1 10. 

21 In step 308, the IVR module 110 records and stores a first message from the contact 

22 102 in a message mailbox 1 12. In step 310, the IVR module associates a priority level 

23 attribute with the contact 102 and the first message. Next in step 312, the IVR module 110 

24 asks the contact 102 to select and assign a priority level, to the first message, from a list of 

25 priority levels. 
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1 In step 314, the IVR module associates a second set of attributes with the first 

2 message. In step 316, the priority level attribute and the second set of attributes are stored in 

3 a message attributes database 1 14. 

4 In step 318, if the contact 102 has requested to be put "on-hold", the IVR module 110 

5 routes the contact 102 to the on-hold queue 116. In step 320, the IVR module 110 collects 

6 and stores a second message from the contact 102 in the message mailbox 1 12. 
7 

8 Acoustic Classifier 

9 Next, in step 322, an acoustic classifier 118 accesses the first and second messages 

10 stored in the message mailbox 112. In step 324, the acoustic classifier 118 generates a set of 

11 emotional confidence scores for the first and second messages with respect to a set of 

12 predefined emotions base on acoustic features found within the messages. Next in step 326, 

13 the acoustic classifier 118 sets a priority level confidence score for the priority level attribute 

14 to a predetermined value based on a predetermined combination of the emotional confidence 

15 scores. In step 328, the acoustic classifier 118 stores the confidence score for the priority 

16 level attribute in the message attributes database 114. 
17 

18 Keyword Classifier 

19 In step 330, the automated speech recognition (ASR) engine within the IVR module 

20 1 10 converts the first and second messages stored in the message mailbox 112 into a textual 

21 file. In step 332, a keyword classifier 120 searches the textual file for a predetermined set of 

22 keywords or key phrases. In step 334, the keyword classifier 120 sets a priority level 

23 confidence score for the priority level attribute to a predetermined value base on whether the 

24 message includes a predefined set and number of the keywords and key phrases. In step 336, 

25 the keyword classifier 120 stores the confidence score in the message attributes database 114. 
26 
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1 Business Relevance Classifier 

2 In step 338, a business relevance classifier 122 searches the textual file, introduced 

3 above, for a predetermined set of business relevance keywords related to a predefined set of 

4 business relevance categories 124. In step 340, the business relevance classifier 122 sets a 

5 priority level confidence score for the priority level attribute to a predetermined value base on 

6 whether the message includes a predefined set and number of the business relevance 

7 keywords. In step 342, the business relevance classifier 122 stores the confidence score for 

8 the priority level attribute in the message attributes database 114. 
9 

10 Contact-Assigned Priority Classifier 

11 In step 344, a contact-assigned priority level classifier 126 identifies the priority level 

12 assigned to the first message by the contact 102. In step 346, the contact-assigned priority 

13 level classifier 126 sets a contact- assigned priority level confidence score equal to one of a set 

14 of predetermined priority level confidence scores, depending upon the priority level assigned 

15 by the contact 102. Next in step 348, the priority level classifier 126 stores the confidence 

16 score for the priority level attribute in the message attributes database 1 14. 
17 

18 Data Combiner 

19 In step 350, a data combiner 128 retrieves each of the confidence scores stored in the 

20 message attributes database 114 by the various classifiers 118, 120, 122, and 126 for the 

21 priority level attribute. In step 352, the combiner 128 dynamically assigns a weight to each of 

22 the confidence scores depending upon the classifier from which the confidence score was 

23 received. In step 354, the data combiner 128 calculates a combined confidence score for the 

24 priority level attribute based on all the confidence scores received from the various classifiers. 

25 In step 356, the combiner 128 stores the combined confidence score for the priority level 

26 attribute in the message attributes database 1 14. 
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1 

2 Sorting and Retrieving from the Message Mailbox and On-Hold Queue 

3 In step 358, the contact manager 108 sorts the messages in the message mailbox 112 

4 and the contacts in the on-hold queue 116 based on their respective combined confidence 

5 scores stored in the message attributes database 114. Next in step 360, the operator 106 

6 requests a next message in the message mailbox 1 12 or connection to a next contact on-hold 

7 in the on-hold queue 1 16. In step 362, the contact manager 108 sends the highest priority 

8 message in the message mailbox 112 to the operator 106, or connects the operator 106 to the 

9 highest priority contact in the on-hold queue 116. 
10 

11 While one or more embodiments of the present invention have been described, those 

12 skilled in the art will recognize that various modifications may be made. Variations upon and 

13 modifications to these embodiments are provided by the present invention, which is limited 

14 only by the following claims. 
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